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In  this  paper,  we  describe  the  first  polynomial-time  combinatorial  algorithms 
for  approximately  solving  the  multicommodity  flow  problem.  Our  algorithms  are 
significantly  faster  than  the  best  previously  known  algorithms,  that  were  based 
on  linear  programming.  For  a  1-commodity  multicommodity  flow  problem,  the 
running  time  of  our  randomized  algorithm  is  (up  to  log  factors)  the  same  as 
the  time  needed  to  solve  1  single-commodity  flow  problems,  thus  giving  the 
surprising  result  that  approximately  computing  a  1-commodity  maximum-flow 
is  not  much  harder  than  computing  about  1  single-commodity  maximum-flows 
in  isolation.  Given  any  multicommodity  flow  problem  as  input,  our  algorithm 
is  guaranteed  to  provide  a  feasible  solution  to  a  modified  flow  problem  in  which 
all  capacities  are  increased  by  a  (1  +  e)-factor,  or  to  provide  a  proof  that  there 
is  no  feasible  solution  to  the  original  problem. 

We  also  describe  faster  approximation  algorithms  for  multicommodity  flow 
problems  with  a  special  structure,  such  as  those  that  arise  in  the  “sparsest  cut” 
problems  and  the  uniform  concurrent  flow  problems  if  1  <  y/m. 
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Abstract 


All  previously  known  algorithms  for  solving  the  multicommodity  flow  problem  with  ca¬ 
pacities  are  based  on  linear  programming.  The  best  of  these  algorithms  [14]  uses  a  fast  matrix 
multiplication  algorithm  and  takes  0(k2  5n~rn  5  \og(nDU))  time  to  find  an  approximate  solu¬ 
tion,  where  k  is  the  number  of  commodities,  n  and  m  denote  the  number  of  nodes  and  edges 
in  the  network,  D  is  the  largest  demand,  and  U  is  the  largest  edge  capacity.  Substantially 
more  time  is  needed  to  find  an  exact  solution.  As  a  consequence,  even  multicommodity  flow 
problems  with  just  a  few  commodities  are  believed  to  be  much  harder  than  single-commodity 
maximum-now  or  minimum-cost  flow  problems. 

In  this  paper,  we  describe  the  first  polynomial-time  combinatorial  algorithms  for  approxi¬ 
mately  solving  the  multicommodity  flow  problem.  The  running  time  of  our  randomized  algo¬ 
rithm  is  (up  to  log  factors)  the  same  as  the  time  needed  to  solve  k  single-commodity  flow  prob¬ 
lems,  thus  giving  the  surprising  result  that  approximately  computing  a  ^-commodity  maximum- 
flow  is  not  much  harder  than  computing  about  Ic  single-commodity  maximum-flows  in  isolation. 

In  fact,  we  prove  that  a  (simple)  A-commodity  flow  problem  can  be  approximately  solved 
by  approximately  solving  0(k  log"  n)  single-commodity  minimum-cost  flow  problems.  Our  k- 
commodity  algorithm  runs  in  0(kinn  log4  n)  time  with  high  probability.  We  also  describe  a 
deterministic  algorithm  that  uses  an  0(&)-factor  more  time.  Given  any  multicommodity  flow 
problem  as  input,  both  algorithms  are  guaranteed  to  provide  a  feasible  solution  to  a  modified 
flow  problem  in  which  all  capacities  are  increased  by  a  (1  +  c)-factor,  or  to  provide  a  proof  that 
there  is  no  feasible  solution  to  the  original  problem. 

We  also  describe  faster  approximation  algorithms  for  multicommodity  flow  problems  with 
a  special  structure,  such  as  those  that  arise  in  the  “sparsest  cut”  problems  studied  in  [8,  10,  9], 
and  the  uniform  concurrent  flow  problems  studied  in  [12,  9]  if  k  <  y/m. 


1  Introduction 

The  multicommodity  flow  problem  involves  simultaneously  shipping  several  different  commodities 
from  their  respective  sources  to  their  sinks  in  a  single  network  so  that  the  total  amount  of  flow 
going  through  each  edge  is  no  more  than  its  capacity.  Associated  with  each  commodity  is  a 
demand,  which  is  the  amount  of  that  commodity  that  we  wish  to  ship.  Given  a  multicommodity 
flow  problem,  one  often  wants  to  know  if  there  is  a  feasible  flow.  i.e.  if  it  is  possible  to  find  a 
flow  which  satisfies  the  demands  and  obeys  the  capacity  constraints.  More  generally,  we  might 
wish  to  know  the  maximum  percentage  £  such  that  at  least  2  percent  of  each  demand  can  be 
shipped  without  violating  the  capacity  constraints.  The  latter  problem  is  known  as  the  concurrent 
flow  problem ,  and  is  equivalent  to  the  problem  of  determining  the  minimum  ratio  by  which  the 
capacities  must  be  increased  in  order  to  ship  100%  of  each  demands. 

In  this  paper,  we  describe  the  first  combinatorial  approximation  algorithms  for  the  concurrent 
flow  problem.  Given  any  positive  c,  the  algorithms  find  a  feasible  flow  that  ships  at  least  (1  -  c)~ 
percent  of  each  demand,  where  2  is  the  maximum  percentage  obtainable.  The  running  times  of 
the  algorithms  depend  polynomially  on  e-1,  and  are  sign.iicantly  better  than  those  of  previous 
algorithms  when  c  is  a.  constant.  More  specifically,  we  prove  the  following  result.  (Throughout, 
we  use  7i,  m  and  Ic  to  denote  the  number  of  nodes,  edges  and  commodities,  we  assume  that  the 
demands  and  the  capacities  are  integral,  and  use  D  and  U  to  denote  the  largest  demands  and 
capacities,  respectively.) 
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Theorem  1.1  For  any  fixed  c  >  0,  a  (1  —  e)-factor  approximation  to  the  simple1  concurrent  flow 
problem  can  be  found  by  a  randomized  algorithm  in  0(  kmn  log  k  log3  n)  time  and  a  deterministic 
algorithm  in  0(k2mn  log k log3  n)  time,  where  the  constant  depends  on  e. 

Our  expected  running  time  is  the  same  (up  to  polylog  factors)  as  the  time  needed  to  compute 
k  maximum-flows,  thus  giving  the  surprising  result  that  approximately  computing  a  ^-commodity 
concurrent  flow  is  about  as  difficult  as  computing  k  single  commodity  maximum-flows.  In  fact,  we 
formally  prove  that  a  ^-commodity  flow  problem  can  be  approximately  solved  by  approximately 
solving  0(ATog  fclogrj)  mill-cost  flow  problems. 

The  running  times  in  the  above  theorem  can  be  improved  when  k  is  large.  Let  k’  denote  the 
number  of  different  sources.  In  both  the  randomized  and  the  deterministic  algorithm  we  can  replace 
k  in  the  running  time  by  k *  at  the  expense  of  having  to  replace  one  of  the  log  n  terms  by  a  \og(nU). 
Notice  that  k*  is  at  most  n  for  all  multicommodity  flow  problems. 

As  a  consequence  of  our  approximation  algorithm  for  the  concurrent  flow  problem,  we  obtain  a 
relaxed  decision  procedure  for  multicommodity  flow  feasibility.  In  particular,  given  a  multicommod¬ 
ity  flow  problem,  we  can  either  prove  that  it  is  infeasible,  or  give  a  feasible  flow  for  the  problem  in 
which  every  capacity  is  increased  by  a  factor  of  1  +  e.  Since  in  practice,  the  input  to  a  multicom¬ 
modity  flow  problem  may  have  some  measurement  error,  by  making  c  small  enough,  we  can  obtain 
a.  procedure  for  determining  feasibility  up  to  the  precision  of  the  input  data. 

The  only  previous  algorithms  for  solving  (or  approximately  solving)  the  general  concurrent  flow 
problem  use  linear  programming.  The  concurrent  flow  problem  can  be  formulated  as  a  linear  pro¬ 
gram  in  0{mk)  variables  and  0(nl;  +  in)  constraints.  Linear  programming  can  be  used  to  solve 
the  problem  optimally  in  polynomial  time.  Kapoor  and  Vaidya  [7]  gave  a  method  to  speed  up 
the  matrix  inversions  involved  in  Karmarkar-tvpe  algorithms  for  multicommodity  flow  problems: 
combining  their  technique  with  Vaidya’s  new  linear  programming  algorithm  that  uses  fast  matrix 
multiplication  [14]  yields  a  time  bound  of  0(/:3-5n3m-5  \og(iiDU))  for  the  concurrent  flow  problem 
with  integer  demands  and  an  0{k2-5n2m-5\og(ne~l  DU))  time  bound  for  the  approximation  prob¬ 
lem.  When  e  is  not  too  small  (e.g.  if  e  is  constant),  then  the  running  time  of  our  algorithm  is  much 
faster  than  that  of  the  previous  algorithms  for  most  multicommodity  flow  problems.  In  addition, 
the  fact  that  our  algorithm  consists  of  only  0(k  log  k\ogn)  minimum-cost  flow  computations  means 
that  it  might  be  more  suitable  for  implementation  in  practice.  (Minimum-  '>st  flow  problems  are 
efficiently  handled  by  the  network  simplex  algorithm  in  practice.) 

The  only  previous  combinatorial  polynomial  approximation  algorithms  for  concurrent  flow  prob¬ 
lems  handle  only  the  special  case  when  all  the  capacities  are  1.  For  this  special  case,  Shahrokhi 
and  Matula  [12]  gave  an  algorithm  that  ran  in  O(nm')  time.  A  faster  algorithm  was  later  given 
by  Klein,  Plotkin,  Stein,  and  Tardos  [9]  which  runs  in  expe  ted  0{(k  +  m)(m  +  a  log n)  log  n) 
time.  Our  new  algorithm  can  be  applied  to  this  special  case  and  gives  improved  bounds  when 
k  <  \/m/ ( log  n  log/c). 

Our  algorithm  is  similar  in  spirit  to  those  of  [12]  and  [9]  in  that  we  start  with  a  flow  that 
satisfies  the  demands  but  not  the  capacity  constraints,  and  then  we  iteratively  reroute  parts  of  the 
flow  so  as  to  produce  a  flow  that  is  closer  to  optimal.  However,  our  algorithm  can  handle  networks 
with  arbitrary  capacities.  Our  approach  differs  from  that  in  previous  work  in  that  we  are  able 
to  reroute  an  entire  commodity  during  eaOi  iteration  instead  of  only  a  single  path  of  flow.  To 

'By  stmple,  we  mean  that  each  commodity  has  a  single  source  and  a  single  sink. 
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do  this,  we  compute  a  minimum-cost  flow  in  an  auxiliary  graph  and  reroute  a  portion  of  the  flow 
accordingly.  As  a  consequence,  we  are  able  to  make  much  greater  progress  during  each  iteration. 
Of  course,  the  time  to  run  each  iteration  goes  up.  but  the  tradeoff  proves  to  be  worthwhile  since  the 
improvement  obtained  in  each  iteration  is  large  enough  so  that  we  need  to  solve  only  0( k  log  k  log  v ) 
minimum-cost  flow  problems  in  order  to  get  an  approximately  optimal  solution. 

The  running  times  of  the  presented  algorithms  depend  polynomials  on  e-1.  The  deterministic 
algorithm  runs  in  time  proportional  to  e-2  and  the  randomized  one  runs  in  time  proportional  to 
f-3.  Goldberg  [3]  and  Grigoriadis  and  Khachiyan  [5]  have  shown  how  to  improve  the  dependence 
on  e  of  the  randomized  algorithm  to  c~2. 

Leighton  and  Rao  [10]  have  shown  how  to  use  an  approximately  optimal  solution  to  a  concurrent 
flow  problem  to  find  an  approximately  sparsest  cut  in  a  graph.  As  a  consequence,  they  also  showed 
how  to  approximately  solve  a  wide  variety  of  NP-hard  graph  problems,  including  minimum  feedback 
arc  set,  minimum  cut  linear  arrangement,  and  minimum  area  layout.  This  result  has  recently  been 
generalized  by  Klein,  Agrawal,  Ravi  and  Rao  [8]  to  find  an  approximately  most  congested  cut  in  a 
general  concurrent  flow  problem.  Given  a  solution  to  the  concurrent  flow  problem,  they  showed  how 
to  approximately  solve  a  variety  of  NP-hard  problems,  including  minimum  deletion  of  clauses  of  a 
2-CNF=  formula,  via  minimization,  minimum  chordalization  of  a  graph  and  register  sufficiency. 

The  previously  known  concurrent  flow  algorithms  [12,  9]  cannot  be  used  in  these  approximation 
algorithms  except  in  the  special  case  of  problems  without  capacities,  or  edge  weights.  The  only 
algorithms  previously  known  for  the  capacitated  case  used  linear  programming.  Using  the  results  in 
this  paper,  we  can  now  efficiently  approximate  all  the  problems  considered  above  for  arbitrary  edge- 
weighted  and  node-weighted  graphs  (when  appropriate).  For  example,  we  can  prove  the  following 
result. 

Theorem  1.2  The  most  congested  cut  in  a  graph  with  integral  demands  and  capacities  can  be  ap¬ 
proximated  within  a  factor  of  O(lognlog/:D)  in  expected  0{kmnm  log3  nlog  ?i(7)  time,  where  /,’*  is  the 
number  of  different  sources  among  the  commodities. 

The  concurrent  flow  algorithm  can  also  be  used  to  give  an  0(n2m  log3  7)  log  nU  )  expected  time 
algorithm  for  finding  a  cut  in  an  edge  (and  node)  weighted  graph  that  is  sparsest  up  to  a  factor  of 
O(logn).  For  the  important  special  case  of  regular  graphs  and  unit  node  weights,  we  can  further 
improve  this  bound  to  0(m2  log3  n). 

Our  model  of  computation  is  the  RAM.  We  shall  use  the  elementary  arithmetic  operations 
(addition,  subtraction,  comparison,  multiplication,  and  integer  division),  and  count  each  of  these 
as  a  single  step.  All  numbers  occurring  throughout  the  computation  will  have  at  most  O(\o"(nlr)) 
bits.  For  ease  of  exposition,  in  Section  4  we  shall  use  a  model  of  computation  that  allows  exact 
arithmetic  on  real  numbers  and  we  shall  assume  that  exponentiation  is  a  single  step.  In  Section  5 
we  show  how  to  convert  the  results  to  the  usual  RAM  model. 

2  Preliminaries  and  Definitions 

An  instance  of  the  simple  multicommodity  flow  problem  consists  of  an  undirected  graph  G  —  ( 1  ’.  E ). 
a  non-negative  capacity  u(vw)  for  every  edge  vw  6  E ,  and  a  specification  of  k  commodities, 
numbered  1  through  k ,  where  the  specification  for  commodity  i  consists  of  a  source-sink  pair 
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st,t(  £  V  and  a  rion-negative  demand  d,.  We  will  denote  the  number  of  different  sources  by  A*, 
the  number  of  nodes  by  n,  and  the  number  of  edges  by  m.  For  notational  convenience  we  assume 
that  m  >  n,  and  that  the  graph  G  is  connected  and  has  no  parallel  edges.  Also,  for  notational 
convenience,  we  arbitrarily  direct  each  edge.  If  there  is  an  edge  directed  from  v  to  w.  this  edge  is 
unique  by  assumption,  and  we  denote  it  by  vw.  We  assume  that  the  capacities  and  the  demands 
are  integral,  and  denote  the  largest  capacity  by  U  and  the  largest  demand  by  D. 

A  multicommodity  flow  /  consists  of  a  function  fi(vw)  on  the  edges  of  G  for  every  commodity 
i,  which  represents  the  flow  of  commodity  /  on  edge  vw.  If  the  flow  of  commodity  i  on  edge  vw  is 
oriented  in  the  same  direction  as  edge  vw,  then  fi{vw)  will  be  positive,  otherwise  it  will  be  negative. 
The  signs  only  serve  to  indicate  the  direction  of  the  flows.  For  every  commodity  i  we  require  the 
conservation  constraints: 

(1)  H  /i(??“’)  =  °  for  every  node  v  g  {«,,/,}. 

wvG-E  vw(zE 

We  require  also  that  J2vw€E  Mvw)  ~  'A  for  v  =  st.  We  define  the  value  of  the  total  flow 
on  edge  vw  to  be  /(vw)  =  l/i'(vtt;)K  and  say  that  a  multicommodity  flow  /  in  G  is  feasible  if 
f(viv)  <  u(vw)  for  all  edges  vw.  (Note  that  f(vw)  is  always  non-negative.) 

We  consider  the  optimization  version  of  this  problem,  called  the  simple  concurrent  flow  problem. 
first  defined  by  Shahrokhi  and  Matula.  [12].  In  this  problem  the  objective  is  to  compute  the 
maximum  possible  value  z  such  that  there  is  a  feasible  multicommodity  flow  with  demands  z  elj  for 
every  1  <  i  <  A.  We  call  £  the  throughput  of  the  multicommodity  flow.  An  equivalent  formulation 
of  the  concurrent  flow  problem  is  to  compute  the  minimum  A  =  1/;  such  that  there  is  a  feasible 
flow  with  demands  el,  and  capacities  A  •  u(vw).  We  shall  use  the  notation  A(rie)  to  denote  the 
congestion  f(vw)/v(vtv)  of  an  edge  vw  £  E,  A  =  maxt.u,€E  A( vw).  and  A*  to  denote  the  optimal 
(minimum)  value  of  A. 

A  multicommodity  flow  /  satisfying  the  demands  d,  is  e-optimal  if  A  is  at  most  a  factor  (1  -f  c) 
more  than  the  minimum  possible  value.  The  approximation  problem  associated  with  the  concurrent 
flow  problem  is  to  find  an  c-optimal  multicommodity  flow  /.  We  shall  assume  implicitly  throughout 
that  c  is  at  least  inverse  polynomial  in  n  and  is  at  most  1/9.  If  c  is  trigger  than  1/9.  we  can  run  the 
algorithm  for  c  =  1/9.  If  e  is  less  than  any  polynomial  in  «,  our  algorithms  will  still  yield  a  correct 
solution.  However,  in  this  case,  the  running  times  of  our  algorithms  will  be  somewhat  greater  and 
will  be  dominated  by  the  time  to  solve  the  problem  exactly. 

We  can  extend  all  the  results  in  the  paper  to  the  case  where  the  input  graph  is  directed.  In 
this  case  we  require  that  all  flows  are  non-negative  and  oriented  in  the  same  direction  as  the  input 
graph.  It  is  easy  to  verify  that  all  the  results  in  this  paper  carry  through  to  this  case.  Henceforth, 
we  focus  only  on  the  undirected  case. 

The  general  multicommodity  flow  problem  is  a  natural  extension  of  the  simple  problem  when 
each  commodity  has  more  then  one  source  and  sink.  For  every  commodity  i  we  are  given  a  demand 
vector  d{(v).  (A  negative  demand  denotes  a  supply.)  We  require  that  ]Tlf  d,(r)  =  0  and  we  shall 
use  Di  to  denote  maxv{|dd^)|}-  The  conservation  constraints  of  equation  (1)  are  replaced  by  the 
more  general  conservation  constraints: 

(2)  £  fi(wv)  -  ^2  fi(vw)  =  di(v)  for  every  commodity  /  and  every  node  v. 

u >v£E  vw£E 


Many  of  our  results  can  be  extended  to  this  slightly  more  general  model.  However,  the  main 
point  in  introducing  this  model  is  to  reduce  the  number  of  commodities.  Every  simple  concurrent 
flow  problem  is  equivalent  to  a  general  concurrent  flow  problem  with  at  most  n  commodities. 
Because  of  this  fact  and  because  the  running  times  of  our  algorithms  are  proportional  to  the 
number  of  commodities,  we  will  assume  that  the  number  of  commodities  is  polynomial  in  n;  this 
will  simplify  the  expressions  for  the  running  times. 

We  can  convert  a  simple  concurrent  flow  problem  to  a  general  concurrent  flow  problem  with  km 
commodities  by  combining  those  commodities  which  share  a  source.  For  each  source  s  we  define 
a  demand  vector  ds(v)  as  follows:  for  each  commodity  i  with  .s;  =  s  we  set  ds(tt)  =  d,;  we  set 
ds(s)  =  -  £{d,  :  Si  =  <s};  all  other  demands  are  set  to  zero. 

Lemma  2.1  Consider  a  simple  k  commodity  concurrent  flow  problem  and  the  corresponding  k~- 
commodity  problem  defined  above.  Any  feasible  solution  to  one  can  be  converted  to  a  solution  to 
the  other  with  the  same  value  of  A.  The  conversion  of  a  solution  for  the  /.’-commodity  problem  to 
one  for  the  k  commodity  problem  can  be  done  in  0( kmnin)  time,  or  in  0(k"m  log  n)  time  using  the 
dynamic  tree  data  structure. 

Proof:  The  conversion  of  a  solution  of  the  simple  concurrent  flow'  with  k  commodities  into  a 
solution  of  the  ^'-commodity  problem  is  straightforward.  Assume  that  we  are  given  a  solution  to 
the  general  concurrent  flow  problem  with  k‘  commodities.  Decompose  the  flow  of  each  commodity 
into  paths  and  cycles  and  combine  the  flows  on  paths  that  have  the  same  source  and  sink  nodes, 
disregarding  the  cycles.  The  running  time  of  this  procedure  is  dominated  by  the  time  it  takes  to 
decompose  flows  into  paths  and  cycles,  which  yields  the  claim  of  the  lemma.  | 

Notice  that  the  sources  and  sinks  play  a  symmetric  role  in  the  (undirected)  problem,  and  hence 
/>■*  in  the  lemma  could  have  been  defined  as  the  number  of  nodes  in  a  subset  that  contains  an 
endpoint  of  each  commodity.  While  finding  a  minimum  such  node  set  is  NP-complete,  we  mention 
this  formulation  because  in  some  cases  it  leads  to  an  efficiently  computable  k*  which  is  smaller  than 
the  one  defined  above. 

Lemma  2.1  implies  that  one  can  replace  most  of  the  bounds  that  are  dependent  on  k  by  ones 
that  are  dependent  on  k*.  Throughout  this  paper,  unless  we  explicitly  state  that  a  bound  is  for 
the  simple  concurrent  flow  problem,  k  can  be  replaced  bv  k'  when  applied  to  a  simple  concurrent 
flow  problem. 

The  main  subroutine  of  our  algorithm  is  a  minimum-cost  flow  computation  (of  a  single  com¬ 
modity).  We  will  use  the  following,  slightly  unconventional  definition.  Given  a  cost  vector  c  £  R^, 
the  cost  of  a  flow  /,  is  ^f,vweE  c(tm)|/,(tnn)|.  Given  a  demand  vector  el,(  v),  and  capacities  the 
minimum-cost  flow  problem  is  the  problem  of  finding  a  flow  of  minimum  cost  which  satisfies  the 
conservation  constraints  (2)  and  has  |/,(me)|  <  v'(vw)  for  every  edge  vw.  The  residual  graph  of 
a  flow  /,  is  the  graph  consisting  of  the  set  of  edges  for  which  fi(vw)  <  ti’(vw)  and  the  reversal 
of  the  set  of  edges  for  which  fi{vw)  >  -u'(viv).  In  Section  6.2,  we  will  need  to  work  with  the 
linear-programming  dual  of  a  minimum-cost  flow.  The  dual  variables  on  the  nodes  are  commonly 
referred  to  as  prices ,  and  will  be  denoted  by  p.  A  price  function  is  a  vector  p  £  Rl  .  The  reduced 
cost  of  an  edge  vw  £  E  is  c(vw)  +  p(v)  -  p{w),  and  the  negative  of  this  for  reverse  edges.  Linear 
programming  duality  implies  that  a  flow  /,  is  of  minimum-cost  if  and  only  if  there  exists  a  price 
function  p,  such  that  the  reduced  cost  of  the  edges  in  the  residual  graph  of  /,  are  nonnegative 
(complementary  slackness  conditions). 
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Linear  programming  duality  can  also  be  used  to  give  a  characterization  of  the  optimum  solution 
for  the  concurrent  flow  problem.  Let  C  :  E  —  R  be  a  nonnegative  length  function.  For  nodes 
v,w  €  V  let  distf(v,w)  denote  the  length  of  the  shortest  path  from  e  to  ir  in  G  with  respect  to 
the  length  function  t.  The  following  theorem  is  a  special  case  of  the  linear  programming  duality 
theorem. 

Theorem  2.2  Fora  simple  multicommodity  flow  /  satisfying  the  demands  d,  and  capacities  A  -u(vw), 
and  any  length  function  £, 

_  _  k  k 

(3)  A  ^  C(vw)ti(vw)>  ^  f(vw)t(vw  )  =  E  E  £{vw)\fi(vw)\  >  ^2distt{si,ti)di. 

vw£E  vw£E  1  =  1  vw£E  i=l 

Furthermore,  a  multicommodity  flow  /  minimizes  A  if  and  only  if  there  exists  a  nonzero  length  function 
(  for  which  all  the  above  terms  are  equal. 


3  Relaxed  Optimality  Conditions 

Theorem  2.2  is  a  characterization  of  optimality  that  relates  the  value  of  A  to  the  lengths  of  the 
shortest  path  for  each  commodity.  To  drive  our  algorithm,  we  will  use  a  slightly  different  character¬ 
ization,  one  which  relates  the  value  of  A  to  the  costs  of  minimum  cost  flows  in  appropriately  derived 
graphs.  While  these  characterizations  can  be  proven  to  be  equivalent,  by  measuring  optimality  in 
terms  of  minimum-cost  flows,  we  are  able  to  develop  faster  algorithms. 

Let  £  be  a  nonnegative  length  function  on  the  edges,  /  a  multicommodity  flow,  and  A  = 
maxvwgE  X(vw).  Let  C,  be  the  cost  of  the  current  flow  for  commodity  i,  using  (  as  the  cost 
function.  For  a  commodity  i,  let  C * ( A )  be  the  value  of  a  minimum-cost  flow  /*  satisfying  the 
demands  of  commodity  i,  subject  to  costs  C  and  capacities  A  ■  u(vw),  i.e.  let  /*  be  a  flow  that 
satisfies  |/*(vu;)|  <  A  •  a(vw)  and  minimizes  the  cost  C*(  A)  =  £vw  |/*(mc)|f( vw).  For  brevity  we 
shall  some  times  use  C*  to  abbreviate  C' * ( A ) . 

Theorem  3.1  For  a  (general)  multicommodity  flow  /  satisfying  capacities  A  ■  u(vw),  and  a  length 
function  £, 

k  k  k 

(4)  A  £{vw)u (vio)>  ^2  J2  I Mvw)\C(vw)  =  >  ^C’(A). 

vw£E  i=l  vw~E  z= 1  i=l 

Furthermore,  a  multicommodity  flow  /  minimizes  A  if  and  only  if  there  exists  a  nonzero  length  function 
C  for  which  all  the  above  terms  are  equal. 

We  would  like  to  be  able  to  say  that  the  ratio  of  the  last  term  and  the  multiplier  of  A  in  the  first 
term  gives  a  lower  bound  on  the  optimal  value  A*.  The  analogous  statement  for  the  inequality  (3) 
is  obvious,  because  neither  of  the  two  terms  depend  on  A.  In  Theorem  3.1  the  last  term.  £),•  (T’’(  A ). 
depends  on  A.  Observe,  however,  that  the  minimum  cost  of  a  flow  subject  to  capacity  constraints 
A  •  u(vw)  cannot  increase  if  A  increases. 

Lemma  3.2  Suppose  that  we  have  a  multicommodity  flow  satisfying  capacities  A  •  u{  vw)  and  f  is  a 
length  function.  Then  the  value  C*(X)/(Y^,vw^e  £(vw)u(vw))  is  a  lower  bound  on  A'. 
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The  goal  of  our  algorithms  is  to  find  a  multicommodity  flow  /  and  a  length  function  f  such  that  t  his 
lower  bound  is  within  a  ( 1  -f  e)  factor  of  optimal,  i.e.  A  <  ( 1  +  c)  Yli=\  C*(A )/{J2vweE  f(  ('«•)?/(  nr)). 
In  this  case,  we  say  that  /  and  l  are  c-optimal.  If  /  and  C  are  c-optimal  then  Lemma  3.2  implies 
that  /  is  e-optimal. 

The  complementary  slackness  conditions  given  by  linear  programming  can  be  reformulated  in 
terms  of  conditions  on  edges  and  individual  commodities.  A  multicommodity  flow  /  has  minimum 
A  if  and  only  if  there  exists  a  nonnegative  and  non-zero  length  function  C  such  that: 

1.  for  every  edge  vw  €  E.  either  C(vw)  =  0  or  f(vw)  -  A  •  u(vw), 

2.  for  every  commodity  i.  C,  —  C’*( A). 

These  two  conditions  characterize  when  /  and  C  are  optimal ;  we  shall  give  two  conditions  on 
a  multicommodity  flow  /  and  a  length  function  C  such  that  together  they  imply  that  /  and  (  are 
(-optimal.  These  conditions  will  be  relaxed  versions  of  the  complementary  slackness  conditions 
above.  Similar  relaxed  versions  of  Theorem  2.2  were  used  in  [9]. 

Let  c  >  0  be  an  error  parameter.  /  a  multicommodity  flow  satisfying  capacities  A  ■  u(vir).  and 
t  a  length  function.  We  say  that  a  commodity  i  is  (-good  if 

Ci-C'i(X)  <  eCi  +  (j  ^2  u(vw)t(vw). 

k  vu>eE 

Otherwise,  we  sav  that  the  commodity  is  e-bad.  Intuitively,  a  commodity  is  c-good  if  it  is  almost 
as  cheap  as  the  minimum  cost  possible  for  that  commodity  or  it  is  at  most  a  small  fraction  of 
A  Y^vwce  u(vw)C(vw),  the  total  cost  of  the  network.  We  use  this  notion  in  defining  the  following 
relaxed  optimality  conditions  (with  respect  to  a  multicommodity  flow  /  that  satisfies  capacity 
constraints  A  •  u(viv),  a  length  function  l  and  an  error  parameter  e): 

(Rl)  For  every  edge  vw  £  E  either  (1  +  c)f(vxv)  >  A  •  u(vio) 
or  u(rw)((vw)  <  ^  YlvweE  n(vw)t(vw). 

A 

(R2)  X]  Cf<(j:C?(A). 

i  e-bad  ,  — ' 

By  a  proof  similar  to  that  of  Theorem  3.2  of  [9],  we  can  show  that  if  we  can  satisfy  the  relaxed 
optimality  conditions  then  we  actually  have  an  0(c)-optimal  flow. 

Theorem  3.3  Suppose  /,  (,  and  e  satisfy  the  relaxed  optimality  conditions  and  c  <  1/9.  Then  /  is 
0(c)-optimal,  i.e.  A  is  at  most  a  factor  (1  +  9c)  more  than  the  minimum  possible  value. 

As  we  shall  see  in  the  next  section,  the  relaxed  optimality  conditions  will  guide  our  algorithm. 

4  Solving  Concurrent  Flows 

In  this  section,  we  give  approximation  algorithms  for  the  concurrent  flow  problem.  As  the  basic 
step  of  our  algorithm  is  finding  a  minimum-cost  flow,  we  bound  the  time  needed  to  find  a  concurrent 
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flow  in  terms  of  a  number  of  minimum-cost  flow  computations.  In  Section  4.1.  we  will  show  how  to 
find  a  “good’’  initial  solution  to  the  given  concurrent  flow  problem.  In  Section  4.2.  we  will  describe 
procedure  Decongest.  which  takes  a  flow  with  congestion  A  and  produces  a  new  flow  that  is  either 
9e-optimal  or  has  congestion  at  most  A/2.  Finally,  in  Section  4.3  we  will  use  these  results  to  give 
bounds  for  how  long  it  takes  to  solve  a  concurrent  flow  problem  in  terms  of  the  number  of  minimum 
cost  flow  computations  for  two  cases  -  a  case  of  e  being  a  fixed  constant,  and  a  more  involved  case 
in  which  c  is  o(l). 

For  simplicity  of  presentation,  throughout  this  section  we  shall  use  a  model  of  computation  that 
allows  the  use  exact  arithmetic  on  real  numbers  and  provides  exponentiation  as  a  single  step.  In 
Section  5  we  will  show  how  to  modify  our  algorithms  to  work  in  the  standard  RAM  model.  The 
question  of  which  minimum-cost,  flow  algorithm  to  use  is  also  deferred  to  Section  5.  where  we  show 
that  the  cost-scaling  algorithm  of  Goldberg  and  Tarjan  [4]  is  a  good  choice  in  most  instances. 

4.1  Finding  an  Initial  Solution 

To  find  an  initial  solution,  we  separately  route  each  commodity  /'.  For  commodity  i.  we  find  A, 
and  a  flow  /,,  such  that  /,  satisfies  the  demands  of  this  commodity  and  obeys  capacity  constraints 
A;  •  u(vw).  Let  A’  denote  the  minimum  possible  A,.  For  each  commodity  i  we  have  A*  <  A*.  If  the 
commodity  has  a  single  sink  and  a  single  source  with  demand  <7,.  then  the  value  of  the  maximum- 
flow  in  the  graph  with  capacities  u(viu)  is  <■/, / A*.  If  the  commodity  has  more  than  one  sink  or 
source,  then  a  A,  <  2A*  can  be  found  by  binary  search.  Since  A*  must  be  between  Dj/(nU)  and 
nDi ,  we  need  to  try  only  O(lognU)  values.  Therefore,  we  have  the  following  lemma. 

Lemma  4.1  An  initial  multicommodity  flow  satisfying  demands  such  that  A  <  k\m  can  be  found  by 
k  maximum-flow  computations  for  the  case  where  each  commodity  has  a  single  source  and  a  single 
sink.  In  the  case  of  multiple  sources  and  multiple  sinks  a  flow  such  that  A  <  2A'A”  can  be  found  by 
O(lc\ogn[')  maximum-flow  computations. 

4.2  Rerouting  Flow 

Now,  we  show  how.  given  a  flow,  we  can  iteratively  reroute  commodities  in  order  to  produce  a 
new  flow  that  is  closer  to  optimality.  We  give  a  procedure  Decongest  which  takes  a  flow  /  with 
congestion  A0  and  produces  a  new  flow  f  that  is  either  9c-optimal  or  has  congestion  A'  <  Aq/2. 

The  basic  idea  is  that  the  procedure  reroutes  an  appropriately  chosen  fraction  of  the  flow  of 
an  c-bad  commodity  onto  the  edges  of  a  minimum-cost  flow  associated  with  this  commodity  (as 
described  below),  in  order  to  reduce  congestion.  We  use  a  length  function  l(vw)  =  e°^^vu'> / u(vir). 
where  the  value  of  a  will  be  chosen  later.  This  length  function  has  the  property  that  the  length 
of  an  edge  vw  is  a  function  of  the  congestion,  i.e.  the  fraction  (possibly  greater  than  1)  of  the 
capacity  of  that  edge  which  is  being  used.  Intuitively,  bv  using  lengths  as  costs  in  the  computation 
of  the  minimum-cost  flow,  we  are  penalizing  edges  with  high  congestion. 

At  the  beginning  of  procedure  Decongest,  o  is  chosen  so  that  Relaxed  Optimality  Condition 
R 1  is  always  satisfied.  The  act  of  rerouting  flow  gradually  enforces  Relaxed  Optimality  Condition 
R2.  When  both  conditions  are  satisfied,  then  Theorem  3.3  can  be  used  to  infer  that  /  is  0(c)- 
optimal.  Alternatively,  Decongest  terminates  if  A  decreases  by  more  than  a  factor  of  2. 
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Decongest(/,  e) 


a  —  2(l  +  e)A  1€-lln(»7J€  1 )  ;  A0  4 —  A. 

While  A  >  Ao/'2  and  /  and  (  are  not  9c-optimal 

For  each  edge  vw,  £(vu>)  —  eoX^v"  '/ u(i'w). 

Find  an  c-bad  commodity  i. 

Formulate  an  auxiliary  minimum-cost  (low  problem  on  G,  where  each  node  v  has  demand  (/,(r). 

and  the  flow  on  edge  vw  is  constrained  to  be  between  —A  •  u{ tnr)  and  A  •  v(vw). 
Compute  flow  /,’  that  minimizes  C~ ( A )  =  Ylvw  l/"(i’«’)|f(cir)  in  the  auxiliary  problem. 

For  all  vw  €  E ,  fj(vw)  *—  (1  —  a)fj(vw)  +  a f'(vw). 

Return  / 


Figure  1:  Procedure  Decongest 

More  formally,  procedure  Decongest  (see  Figure  1)  takes  as  input  a  multicommodity  flow  / 
with  congestion  Ao,  where  /  satisfies  the  demands,  and  an  error  parameter  c.  In  each  iteration,  we 
first  choose  an  e-bad  commodity  i,  and  formulate  an  auxiliary  minimum-cost  flow  problem.  The 
demand  of  each  node  v  in  the  auxiliary  problem  is  equal  to  d,(v),  and  the  desired  flow  f“(vw)  is 
constrained  to  be  between  —  \-u(vu})  and  A -u(vir).  where  A  is  the  current  congestion.  The  objective 
is  to  minimize  C*( A)  =  \f*(vxv)\C(mv).  Given  an  optimal  solution  to  this  problem,  we  reroute 

a  a  -  fraction  of  the  flow  /,  onto  the  edges  of  /”  by  netting  ft(  vw)  —  (1  -  <r)f,{  vw)  +  rr /*(  vw). 
recompute  the  length  function,  and  repeat  .  Upon  termination,  Decongest  returns  an  improved 
flow  /  which  is  either  9c-optimal  or  has  maximum  congestion  A  <  A0/2. 

We  now  show  that  we  can  always  choose  a  so  that.  Relaxed  Optimality  Condition  R 1  is  satisfied. 

Lemma  4.2  If  /  is  a  multicommodity  flow  which  satisfies  demands  and  a  >  (1  +  c)A_1c_1  ln(mc_1 ) 
then  /  and  length  function  C(vw)  —  ea^ Vw)/u(vv')  satisfy  Relaxed  Optimality  Condition  7?  1 . 

Proof:  We  show  that  if  an  edge  v'w'  violates  the  first  part  of  Relaxed  Optimality  Condition  R 1 
then  it  must  satisfy  the  second  part.  For  this  edge  A  •  u(v'w')  >  (1  +  ()f(v'w!).  Let  r'tr’  be  the 
edge  such  that  A (u*ui*)  =  A.  Then 

J2vwu(V(r)((vw)  >  >  eaA  >  m 

ll(v'w')£(v'w')  ~  ea.\/(l+()  —  ea.\/(l+()  —  { 


I 

In  the  beginning  of  procedure  DECONGEST.  a  is  set  equal  to  2(1  +  cIAq-^-1  ln(mc"')  and 
throughout  Decongest  A  >  Ao/2.  Therefore  o  >  (1  +  e ) A —  1 1  _1  ln(mc_1)  throughout. 

To  measure  progress  of  our  algorithm,  we  introduce  a  potential  function  $  =  ;/(  rtr)((  nr). 

We  now  show  that  rerouting  the  right  amount  of  flow  results  in  a  significant  decrease  in  <I'. 

Lemma  4.3  Let  i  be  an  c-bad  commodity,  c  <  I,  and  let  /*  be  a  minimum-cost  flow  for  this  com¬ 
modity,  as  described  above  and  let  T6FA<^<STV  Let  the  new  flow  for  commodity  i  be  defined  by 
fi(vw)  *—  (1  —  cr)ft(vw)  +  <jf*(vw).  Then  $  -  <!>'  >  fl(  j-4>),  where  is  the  value  of  the  potential 
function  associated  with  the  new  flow. 
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Proof:  Denote  by  i(vw)  and  i'(vw)  the  length  of  edge  vw  before  and  after  rerouting,  respectively. 
Let  6(vw)  denote  the  increase  in  flow  on  vw  due  to  rerouting.  Recall  that,  after  rerouting,  the  flow 
of  the  rerouted  commodity  i  on  vw  is  |(1  -  a)fi(vw)  +  <7/*(i7u>)|,  and  hence  |^(u«>)|  <  a| f‘(vw)  - 
fi(vw) |  <  CT(|/i(me)|  +  |/*(nm)|).  Moreover,  since  both  f,  and  /*  have  congestion  at  most  A, 
|<5(uw)|  <  2cr\u(vw). 

By  definition  of  the  length  function,  t'(vw)  =  e°‘M(vw)+s(vu’)Vu(vw) /u(vw)  =  eQ^vw^v^l’u^+ri /u(vw). 
where  77  =  a6(vw)/u(vw).  Observe  that  1 77I  <  2a<xA  <  e/4  <  1/4.  Using  the  Taylor  series,  we  see 
that  I77I  <  e/4  <  1/4  implies  that  for  all  x,  eT+v  <  ex  +  r)ex  +  f  |r/|er.  Therefore,  we  have: 

C'(vw)  <  C(vw)  +  t]C(vw)  + 

<  «tT(l//(un.Q|  -  |/j(tw)|)£  |  eacr(\Mvw)\+\f’(vw)\) 

u(viv)  2u(viv) 

We  use  this  bound  to  estimate  the  decrease  in  the  potential  function. 


$  -  (C(vw)  -  C\vw))u(vw) 

vu>eE 

-  ~  l/f(t’u,)|K(vu')  ~  oto(-  ^2(\fi(vw)\  +  \f[(vw)\)C(vw). 

VW  vu/ 

Using  that  X3tm,(|//'U’«>)|  +  |/*(vttf)|)f( vw)  <  C,  +  C’(A)  <  2 C,  and  the  fact  that  commodity  i 
is  e-bad  we  get 

(5)  $  -  *'  >  aa(Ci  -  C*( A))  -  aoeCx  >  a<r  (cC,  +  _  o<rfC.  _ 

Plugging  in  the  value  of  o  from  the  statement  of  the  lemma,  we  get  that  the  decrease  is  Q(y4>). 

I 

Theorem  4.4  Procedure  DECONGEST  terminates  in  0(t~3k  log  n )  iterations.  If  the  initial  congestion 
Ao  is  0(e)-optimal  then  DECONGEST  terminates  in  0(e~2k  log  7? )  iterations. 

Proof:  Theorem  3.3  implies  that  if  /  and  {  satisfy  both  of  the  relaxed  optimality  conditions 
than  they  are  9c-optimal.  By  Lemma  4.2,  the  Relaxed  Optimality  Condition  li\  is  maintained 
throughout  all  iterations.  If  /  is  not  yet  9c-optimal  then  Relaxed  Optimality  Condition  R2  is 
not  satisfied.  Hence  there  exists  an  c-bad  commodity.  But  every  rerouting  of  How  from  an  c-bad 
commodity  to  the  corresponding  minimum-cost  flow  results  in  a  reduction  in  4>  of  at  least  fi(^4>). 
Since  1  —  x  <  e~x,  it  follows  that  every  0(k(~2)  iterations  reduce  by  at  least  a  constant  factor. 

Next  we  bound  the  number  of  times  $  can  be  reduced  by  a  constant  factor.  Let  A0  be  the 
congestion  of  the  initial  flow.  For  each  edge  vw,  A  (vw)  <  A0,  so  initially,  4>  <  mf“'°.  We  know 
that  in  the  beginning  of  the  last  iteration  at  least  one  edge  has  congestion  at  least  A0/2  and  all 
edges  have  integral  capacities,  so  4>  >  ei  /2.  Thus  the  number  of  times  4>  can  decrease  by  a 
constant  factor  is  0(«Ao  +  logm)  =  O(oAo).  Combining  this  with  the  number  of  iterations  needed 
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to  reduce  4*  by  a  constant  factor  and  plugging  in  the  value  of  a,  we  get  that  the  total  number  of 
iterations  is  0(c~3k  log(nc_1 )).  We  have  assumed  that  c  is  at  least  inverse  polynomial  in  n ,  so  this 
is  in  fact  O(e~3klogn). 

If  the  initial  flow  is  O(e)-optimal  then  we  know  that  throughout  Decongest  ,  A  will  never  go 
below  (1  +  0{())\q.  Thus,  we  have  the  tighter  bound  of  e«(i+0(«))-1-to  <  4>  <  meaX°.  Combining 
this  with  the  number  of  iterations  needed  to  reduce  4>  by  a  constant  factor  and  plugging  in  the 
value  of  a,  we  get  that  the  total  number  of  iterations  is  0(e~2k  log  n).  | 

The  only  computation-intensive  part  of  Decongest  is  finding  an  e-bad  commodity  and  com¬ 
puting  minimum-cost  flows.  All  the  rest  can  be  done  in  0(/»)  time.  The  simplest  way  to  find  an 
e-bad  commodity  is  to  compute  the  costs  Ct  =  lu,eE  |/,( uir)|f(  nr)  and  the  costs  of  the  minimum- 
cost  flows  and  compare  them.  In  the  worst  case  we  need  to  check  all  k  commodities.  Hence,  an 
iteration  can  be  implemented  in  the  time  it  takes  to  perform  k  minimum-cost  flow  computations. 

As  in  [9],  we  can  perform  this  computation  more  efficiently  by  using  a  simple  randomized 
strategy.  If  we  compute  the  cost  C,  of  each  commodity  and  then  randomly  choose  a  commodity 
with  probability  proportional  to  its  cost,  then  with  probability  of  at  least  e.  we  have  chosen  an 
f-bad  commodity.  By  computing  a  single  minimum-cost  flow  we  can  check  whether  the  commodity 
is  indeed  e-bad.  We  expect  to  perform  this  computation  e_1  times,  and  hence  an  iteration  can  be 
implemented  in  expected  time  equal  to  0{mk)  plus  c_1  times  the  time  to  perform  a  minimum-cost 
flow  calculation. 

Observe  that  if  k  <  n  (this  will  be  the  case  when  Lemma  2.1  is  applied)  the  time  to  compute 
the  cost  of  all  current  flows  is  dominated  by  the  time  to  compute  a  minimum-cost  flow.  If  the 
time  required  to  compute  the  costs  of  the  k  commodities  is  not  dominated,  we  can  use  a  strategy 
similar  to  that  of  [9]  in  which  we  pick  an  edge  with  probability  proportional  to  the  cost  of  flow 
through  this  edge,  and  then  a  commodity  with  probability  proportional  to  the  cost  of  flow  of 
this  commodity  through  this  edge,  and  reduce  the  time  for  random  selection  from  O(km)  to  the 
minimum  of  0{m  +  k)  and  0(m  log  k). 

After  every  k  iterations  we  can  compute  minimum-cost  flows  associated  with  all  the  flows  and 
determine  whether  the  current  flow  is  9f-optimal.  Therefore,  we  can  implement  Decongest  as 
a  Las- Vegas  algorithm.  Note  that  this  results  in  at  most  a  factor  of  2  increase  in  the  number  of 
minimum-cost  flows  computed  during  the  execution  of  Decongest.  We  summarize  the  combina¬ 
tion  of  this  discussion  with  Theorem  4.4. 

Theorem  4.5  Procedure  Decongest  can  be  implemented  randomly  using  an  expected  0(c_4/>' log  77) 
minimum-cost  flow  computations  and  O((~4mk\ogv  \og  k)  additional  time,  or  deterministically  using 
0((~3k2  log  7i )  minimum-cost  flow  computations,  assuming  that  exponentiation  can  be  implemented  in 
0(1)  time.  If  the  initial  congestion  A0  is  0(c)  optimal,  then  both  the  randomized  and  deterministic 
versions  of  DECONGEST  can  be  implemented  in  fi(c-1)  less  time. 

4.3  Putting  It  Together 

We  consider  two  cases  for  solving  a  concurrent  flow  problem.  We  first  consider  the  case  when  c  is 
a  fixed  constant  less  than  1/9.  In  this  case,  we  first  find  an  initial  solution  by  solving  0(k\og(nU )) 
maximum  flow  problems,  as  is  discussed  in  Section  4.1.  This  gives  us  a  flow  with  A  <  2kX‘ .  We 
then  call  Decongest  O(logk)  times  in  order  to  produce  a  flow  such  that  A  <  (1  +9c)A*.  Applying 
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the  first  part  of  Theorem  4.5  we  get  the  following  result: 

Theorem  4.6  For  a  constant  c,  an  e-optimal  solution  for  the  concurrent  flow  problem  can  be  found  af¬ 
ter  initialization  (Lemma  4.1)  by  a  randomized  algorithm  that  uses  an  expected  number  of  0(k  log  n  log  k) 
minimum-cost  flow  computations  and  0(  km  log  n log2  k)  additional  time,  or  deterministically  using 
0(k2  log  n  log  k)  minimum-cost  flow  computations,  if  exponentiation  can  be  implemented  in  0(1)  time. 

Observe  that  for  most  known  algorithms  the  time  to  perform  0{k log  n  log  k)  minimum-cost  flow 
computations  dominates  the  time  to  perform  0(k\og(nU ))  maximum  flow  computations  needed  for 
the  initialization  stage  when  we  solve  and  instance  of  the  general  multicommodity  flow  problem. 

When  e  is  o(l)  we  use  e-scaling.  First  we  find  an  e-optimal  multicommodity  flow  with  e  =  1/9 
using  the  above  procedure.  The  rest  of  the  computation  is  divided  into  scaling  phases.  We  start 
each  phase  by  dividing  e  by  2.  Thus  our  current  flow  is  lSe-optimal  with  respect  to  the  new  e.  The 
second  part  of  Theorem  4.5  implies  that  the  expected  number  of  minimum-cost  flow  computations 
needed  to  convert  this  flow  into  an  9e-optimal  one  is  bounded  by  O(c~3k\og  n).  The  time  spent 
on  the  e-scaling  phase  is  proportional  to  e-3,  and  therefore  the  last,  scaling  iteration  dominates  the 
time  spent  on  all  the  scaling  iterations. 

Theorem  4.7  For  e  >  0,  an  e-optimal  solution  for  the  concurrent  flow  problem  can  be  found  after 
initialization  (Lemma  4.1)  by  a  randomized  algorithm  that  uses  an  expected  number  of  0(k(logk  + 
e“3)logn)  minimum-cost  flow  computations,  and  O(km(log  k  +  e-3)  log /.Tog  n)  additional  time,  or 
deterministically  using  0(k2( log  k  +  e-2  )  log  n)  minimum-cost  flow  computations,  if  exponentiation  can 
be  implemented  in  0(1)  time. 

Goldberg  [3]  and  Grigoriadis  and  Khachiyan  [5]  have  shown  how  to  reduce  the  running  time 
of  our  randomized  algorithms  by  an  e_1  factor.  Goldberg  gives  a  somewhat  simplified  version  of 
our  proof  that  leads  to  a  randomized  selection  strategy  which  avoids  having  to  search  for  an  e-bad 
commodity.  Grigoriadis  and  Khachiyan  generalize  our  algorithm  to  solve  certain  types  of  convex 
programming  problems.  Their  algorithm,  when  specialized  to  the  case  of  solving  multicommodity 
flows,  also  avoids  searching  for  an  c-bad  commodity. 


5  Implementing  One  Iteration  of  Decongest 

In  this  section  we  shall  address  the  issue  of  how  to  implement  an  iteration  of  the  procedure 
Decongest.  In  the  previous  section,  we  assumed  a  non-standard  model  of  computation  that 
allows  exponentiation  to  be  implemented  in  0(1)  time.  In  this  section,  we  show  how  to  implement 
an  iteration  in  the  standard  RAM  model  of  computation,  achieving  the  same  time  bounds.  We 
then  derive  bounds  on  the  time  to  find  a  minimum-cost  flow. 

More  specifically,  in  Section  5.1,  we  will  first  show  that  a  flow  that  satisfies  a  relaxed  set  of 
minimum-cost  flow  constraints  will  suffice.  We  then  show  that  a  flow  satisfying  a  second  set  of 
relaxed  constraints  can  be  modified  in  0(m)  time  to  satisfy  the  first  set  of  relaxed  constraints  while 
having  the  additional  property  that  the  resulting  flow  can  be  represented  in  0(\og(nU))  bits  per 
commodity /edge  pair.  We  then  give  an  approximate  length  function  that  uses  0(\og{nU))  bits 
per  edge  which  can  be  used  in  a  minimum-cost  flow  algorithm  to  produce  a  flow  that  satisfies  the 
second  set  of  relaxed  constraints. 
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In  Section  5.2,  we  discuss  which  minimum-cost  flow  algorithm  to  use.  We  will  use  different 
minimum  cost  flow  algorithms  in  different  situations.  For  general  concurrent  flow  problems,  the 
best  choice  seems  to  be  either  the  algorithm  of  Goldberg  and  Tarjan  [4]  or  that  of  Ahuja,  Goldberg. 
Orlin  and  Tarjan  [1].  For  concurrent  flow  with  uniform  capacity,  we  use  Gabow  and  Tarjan'.s  [2] 
algorithm  for  the  assignment  problem.  When  both  the  demands  and  capacities  are  uniform,  we 
use  the  algorithm  that  iteratively  computes  shortest  paths  in  the  residual  graph  with  nonnegative 
costs  discovered  independently  by  Ford  and  Fulkerson  [6]  and  Yakovleva  [15]. 


5.1  Rounding  the  Flows  and  Lengths 

Procedure  Decongest,  as  described  in  the  previous  section,  iteratively  computes  /*.  which  is  a 
flow  that  satisfies  the  demands  of  commodity  i  subject  to  capacity  constraints  Xv(vtv)  on  each  edge 
uiu,  and  minimizes  C*  =  Y,vweE  |/’(eu>)|C(mr).  Instead,  we  will  compute  an  approximation  /” 
to  /*.  The  flow  /*  can  have  cost  somewhat  more  than  the  cost  of  f’,  and  it  may  satisfy  slightly 
relaxed  capacity  constraints.  The  key  to  showing  that  this  flow  can  be  used  in  the  algorithm  instead 
of  /*  is  to  prove  a  relaxed  version  of  Lemma  4.3. 


Theorem  5.1  Let  C,  denote  the  cost  of  the  current  flow  of  commodity  i  with  respect  to  the  current 
length  function,  and  let  f"  be  a  flow  that  satisfies  demands  of  commodity  /  and  the  constraints 


Vvw  E  E  :  f'(vw)  <  2Xu(vw) 

ZvwtE  \f?(vw)\C(vw)  <  C-  +  \ ((Ct  +  c^). 


Then,  if  we  use  /*  instead  of  /*  in  the  concurrent  flow  algorithm  with  <  a  <  we  get  a 

bound  on  the  decrease  of  the  potential  function  by  fl(  j-$). 


Proof:  The  difference  between  this  proof  and  that  of  Lemma  4.3  is  as  follows.  Here  we  can 
conclude  that  |6(tnu)|  <  3uXu(vtv),  and  I77I  <  3oaA  <  3c/16.  We  use  that  |7;|  <  3c/l(j  <  1/4 
implies  eT+v  <  ex  +  rje1  +  p||7/|er.  We  modify  equation  (5)  appropriately,  and  conclude  that 
$  -  =  ft(£).  I 

In  fact,  we  won’t  find  such  a  flow  directly.  What  we  will  do  is  to  compute  a  flow  that  satisfies 
the  somewhat  tighter  constraints, 


Vvw  6  E  :  /*(tm>)  <  jXu(vtv) 

EvweE  \fiivw)\t(vw)  <  C-  +  i(cC,  +  c^). 


We  will  then  modify  this  flow  slightly  so  that  it  satisfies  conditions  (C)  and  the  new  flow  can  be 
represented  in  0(\og(nU))  bits. 


Theorem  5.2  Let  /,  be  a  flow  that  satisfies  conditions  (7).  Then,  in  O(m)  time,  we  can  convert  it 
into  a  flow  /,  that  satisfies  (6)  and  such  that  ( 1  -o)fi(viv)  +  a f*{vw)  can  be  represented  in  0(log(n?r)) 
bits. 


Proof:  Given  the  flow  /,,  we  first  compute  the  flow  (1  -  a)f,  +  of*  where  a  is  chosen  as  in 
Theorem  5.1.  In  order  to  allow  this  flow  to  be  represented  in  0(log(»T))  bits,  we  will  round  the 
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flow  on  edge  vw  to  an  integer  multiple  of  v  =  e2/(128 m2ka).  Observe  that  if  we  just  rounded  the 
flow  on  every  edge  vw  to  the  nearest  integer  multiple  of  v,  we  would  have  no  guarantee  that  the 
flow  conserva  tion  constraints  of  equation  (2)  are  still  satisfied.  Thus,  we  must  round  more  carefully. 

Let  T  be  a  spanning  tree  in  the  graph.  We  round  the  flow  on  all  the  non-tree  edges  to  the  nearest 
multiple  of  //.  This  rounded  flow  will  not  necessarily  satisfy  the  conservation  constraints,  so  we 
use  the  tree  edges  to  correct  for  the  violations  we  may  have  introduced.  It  is  easy  to  see  that  by 
computing  the  flow  values  on  the  edges  of  T  in  topological  order  we  can  carry  out  this  step  in  0(  m ) 
time.  Observe  that  the  amount  of  flow  we  had  to  add  to  any  non-tree  edge  is  at  most  u  and  the 
amount  that  we  had  to  add  to  any  tree  edge  is  at  most  mu,  as  the  flow  on  a  tree  edge  may  have  to 
correct  for  the  violation  across  the  cut  defined  by  that  edge  and  the  tree. 

The  resulting  rounded  flow  implicitly  defines  a  /*  as  it  can  be  written  as  ( 1  -  o)fi  +  af~  for 
an  appropriately  chosen  f*.  The  flow  /*  on  edge  vw  is  f*(vw)  plus  rr-1  times  the  rounding  error 
on  the  edge.  We  now  show  that  it  satisfies  the  conditions  (6).  The  rounding  error  on  any  edge 
is  at  most  mu,  therefore  for  every  edge,  /■‘(vw)  <  /’(vw)  +  a~xmu.  Plugging  in  the  bounds  on 
/’(vw)  from  (7)  and  the  values  of  a  and  u  we  get  an  upper  bound  of  |Aw(  rw)  +  ^A.  Since  u(  nr) 
is  integral,  we  conclude  that  j’(viv)  <  2A u(vw).  We  bound  the  cost  of  /’  as  follows. 

Hvw \f’{vw)\t(vu')  <  J2vw(\Ii(vw)\  +  <T~lmv)C(vw) 

<  Ylvw  |  fi(vw)\l(vw)  +  ma~lmu€oX 

<  C*  +  I  ( eCi  +  ^ )  +  tXrll>  (by  (7)  and  the  definitions  of  a  and  u) 

<  C*  +  i  (cC,  +  4^)  (using  4>  >  foA) 

Therefore  we  have  satisfied  the  conditions  of  the  theorem.  | 

Combining  the  previous  two  theorems  we  get  the  following  corollary: 

Corollary  5.3  A  flow  f?  satisfying  equations  (7)  suffices  to  get  a  bound  on  the  decrease  in  the 
potential  function  by  fl(y$)  while  maintaining  flows  represented  by  0(\og(nU ))  bits  per  edge. 

Now  we  will  show  how  to  compute  a  flow  that  satisfies  (7).  Clearly  we  could  do  so  by  finding  a 
minimum-cost  flow  with  respect  to  the  exact  length  function  f. 

Unfortunately,  this  length  function  is  exponential  in  the  size  of  the  input  and  computing  it 
exactly  might  take  too  long.  Instead,  we  will  describe  how  to  compute  an  approximate  length 
function  f,  such  that  the  flow  that  has  minimum  cost  with  respect  to  (  will  have  cost  at  most 
C*  +  eA3>/(8 k)  with  respect  to  L  By  Corollary  5.3,  such  flow  can  be  used  in  order  to  implement 
the  rerouting  step  in  our  algorithm. 

The  new  length  function  l  will  be  integral,  it  will  consist  of  O(log( v('))  bits  per  edge,  will  be 
approximately  related  to  f  by  the  scalar  multiplier  7  =  fen,N/(  l6Umk),  and  will  satisfy  7  ((rw)  < 
t(vw)  on  every  edge  vw.  It  will  take  O(logn)  time  to  compute  ((vw)  on  each  edge  nr.  In  the 
following  we  will  use  C{  and  C*  to  denote  the  current  cost  and  the  minimum  cost  of  commodity  i 
with  respect  to  length  t,  respectively. 

For  each  edge,  first  we  compute  eaU(wj)f\t(vw)-\)  approximately  to  have  at  most  =  c/(  1  (ikm ) 
additive  error,  then  we  multiply  the  result  by  (-117,  divide  by  u(vw).  take  the  integer  part,  and  set 
t(vw)  to  be  this  value.  Using  the  Taylor  series  we  can  compute  one  bit  in  an  cr  in  ()( 1 )  time.  Since 
€a(f(vw)/u[vw)-\)  js  at  most  1  on  every  edge,  it  is  sufficient  to  compute  O(log(  1  /(,'))  bits  to  achieve  the 


14 


desired  approximation.  Computing  the  approximate  length  function  takes  0(log(l/c,'))  =  O(log?;) 
time  for  each  edge,  and  O(mlogn)  time  in  total. 

Because  of  the  approximation  and  the  integer  rounding,  a  flow  /*.  which  has  minimum  cost 
with  respect  to  (,  is  not  necessarily  the  minimum-cost  flow  with  respect  to  (.  However,  we  will 
show  that  a  flow  that  is  minimum-cost  with  respect  to  (  will  satisfy  conditions  (7). 

Lemma  5.4  Let  /*  be  a  flow  that  is  minimum  cost  with  respect  to  the  costs  (  defined  above.  Then 
/*  has  cost  (with  respect  to  ()  at  most  eA<f>/(8 />•)  more  than  the  minimum. 

Proof:  Recall  that  7  =  and  (,'  =  c/(16 ink).  We  bound  the  difference  between  (  and  ->(. 

a  scaled  up  version  of  the  approximate  length  function.  In  computing  ■)(,  we  introduce  errors  in 
two  places.  First,  when  computing  to  a  precision  of  £,  we  introduce  an  error  of  (.  This 

error  gets  scaled  up  by  (~lU/u(vw)  when  we  scale  up  and  gets  increased  by  1  when  we  round  ( 
down  to  an  integer.  Finally,  if  we  scale  C  back  to  be  compatible  with  (,  the  whole  error  gets  scaled 
by  7.  Thus, 

(8)  ((vw)-ji(vw)  <  7  (c  ~ )  +  l)  =  7  (  ,  +  0  • 

y  yu(vw) j  J  \v(vw)  J 

We  defined  C  so  that  fl(vw)  <  C(vw)  on  every  edge,  hence  we  have  that 

(9)  7C?  ^Ci- 

Using  these  two  equations  and  the  fact  that  $  >  eaX  we  get  that: 

<  Evu-l/rK(T’«>)-7C7  (by  (9)) 

<  Evir  l/’l  (({vw)  —  7  f(  •»*«*)) 

d°)  <  EUu,l/*l7(^y  +  l)  (by  (8)) 

<  2ZvwAu(vw)^(^j) 

^  2m.\4>g  ( \<P 

—  16km  SI; 

I 

Notice  that  this  flow  actually  satisfies  slightly  stronger  conditions  than  (7).  We  will  use  this 
stronger  condition  in  the  next  subsection. 

In  the  randomized  implementation  we  used  the  cost  of  the  current  flow  C,  for  the  selection  of 
a  bad  commodity  i.  We  will  use  the  rounded  cost  C'i  instead.  The  rounding  error  is  small  relative 
to  ZiCf,  therefore  using  C,  does  not  significantly  decrease  the  probability  that  a  bad  commodity 
will  be  selected. 

To  summarize,  we  have  just  described  how  to  implement  Decongest  in  the  RAM  model  of 
computation.  We  first  compute  approximation  C  to  the  length  function  (.  Then  we  compute 
the  approximate  cost  of  each  commodity  and  choose  a  commodity  to  reroute,  either  randomly  or 
deterministically.  Next  we  compute  an  approximate  minimum-cost  flow  for  that  commodity  with 
respect  to  the  costs  i.  This  gives  us  an  approximate  minimum-cost  flow  that  satisfies  equations  (7). 
We  then  update  the  flows  for  commodity  i.  Finally,  we  modify  the  updated  flow  as  described  in 
Theorem  5.2,  represent  it  in  0(log(n(/))  bits  per  edge,  and  start  the  next  iteration.  As  the  above 
discussion  shows,  the  time  to  do  this  is  O(mlogn)  plus  the  time  to  compute  a  minimum-cost  flow. 
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Theorem  5.5  For  c  >  0,  an  e-optimal  solution  for  the  concurrent  flow  problem  can  be  found  after 
initialization  (Lemma  4.1)  by  a  randomized  algorithm  that  uses  an  expected  number  of  0(A-(log A-  + 
c-3)log  n)  minimum-cost  flow  computations  and  O(fcm(log  A'+c-3)  log2  n)  additional  time,  or  determin¬ 
istically  using  0(A,2(log  A’-l-f-2)  logn)  minimum-cost  flow  computations,  and  0(A-?7i(log  A  +  c-2 )  log2  n) 
additional  time. 

5.2  Choosing  a  Minimum-Cost  Flow  Algorithm 

In  this  subsection  we  consider  the  problem  of  choosing  the  appropriate  minimum-cost  flow  routine 
to  use  for  finding  a  minimum-cost  flow  subject  to  the  costs  ({ vw ).  In  some  cases  we  will  only 
compute  an  approximate  minimum-cost  flow  subject  to  cost  /  bv  further  rounding  the  costs  before 
the  minimum-cost  flow  computation.  However,  in  all  cases  we  will  find  a  flow  that  satisfies  (7). 
First,  we  consider  the  general  concurrent  flow  problem. 

Lemma  5.6  For  a  commodity  i,  a  minimum-cost  flow  with  respect  to  (  can  be  tound  in 

0(nm  log(n^)  Iog( n2/m)}  time. 

Proof:  The  Goldberg- Tarjan  minimum-cost  flow  algorithm  runs  in  0(nm  log (n2/m  j  g(  nC'))  time, 
where  C  is  the  maximum  value  of  the  cost  of  an  edge  assuming  that  the  costs  are  integral.  For 
the  rounding  described  in  Lemma  5.4,  it  is  easy  to  verify  that  the  maximum  edge  cost  is  at  most 

16kmU  ■ 

£  ® 

The  above  bound  can  be  improved  if  the  capacities  are  small  relative  to  n2/rn.  In  this  case 
we  will  round  the  demands  and  solve  this  rounded  problem  using  the  double  scaling  algorithm 
of  Ahuja,  Goldberg,  Orlin,  and  Tarjan  [1].  We  will  then  satisfy  the  remaining  flow  on  arbitrary 
paths.  This  flow  will  still  satisfy  (7)  and  the  rounding  will  allow  us  to  use  a  faster  algorithm.  More 
precisely,  we  will  prove  the  following  lemma: 

Lemma  5.7  For  a  commodity  i,  a  flow  satisfying  (7)  can  be  found  in  ()(nin  \og(nl:)  loglogfuf')) 
time. 

Proof:  Assume  without  loss  of  generality  that  c-1  is  an  integer  and  define  //  =  Ac/(  l(inA-).  We 
round  the  demands  for  commodity  i  to  integer  multiples  of  /i  such  that  the  absolute  value  of  each 
demand  does  not  increase,  the  rounded  demands  still  sum  to  zero,  and  the  total  decrease  in  the 
absolute  values  of  the  demands  is  at  most  2 n/t.  (Recall  that  each  node  may  have  a  positive  or  a 
negative  demand.)  Since  the  absolute  value  of  the  demand  for  commodity  i  has  not  increased  at 
any  node,  there  must  exist  a  flow  satisfying  these  demands  with  cost  at  most  C*.  subject  to  costs 

C. 

Both  the  demands  and  the  capacities  are  integral  multiples  of  fi.  If  we  divide  both  the  demands 
and  the  capacities  by  /t,  we  get  a  problem  where  the  maximum  capacity  of  an  edge  is  XU/fi  = 
16 Unke~l.  We  can  then  use  the  double  scaling  algorithm  of  Ahuja,  Goldberg,  Orlin  and  Tarjan  [1] 
for  solving  the  minimum-cost  problem  with  rounded  demands.  By  Lemma  5.4,  this  gives  a  flow  that 
satisfies  the  capacity  constraints  Xu(vw)  and  has  cost  at  most  cA$/(8A-)  more  than  the  minimum 
cost  but  does  not  satisfy  all  the  demands.  We  then  satisfy  the  remaining  demands  by  arbitrary 
paths  from  nodes  with  excess  to  nodes  with  deficit.  The  last  step  increases  the  flow  on  an  edge  by  no 
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more  than  2n/i  =  eA/(4 k)  <  Xu(vw)/4,  and  adds  a  total  of  no  more  than  2?i//  X!fe£  f(e)  <  X(4>/{Sk) 
to  the  cost  of  the  flow  subject  to  costs  (. 

Combining  the  minimum-cost  flow  with  the  flows  on  the  additional  paths,  we  get  a  flow  that 
satisfies  (7)  and  proves  the  lemma.  | 

In  the  case  of  the  simple  concurrent  flow  problem  we  can  make  the  time  required  for  solving 
the  minimum-cost  flow  problem  independent  of  U. 


Lemma  5.8  For  the  simple  concurrent  flow  problem,  a  flow  of  a  commodity  i  satisfying  (7)  can  be 
found  in  the  minimum  of  0 (nm  log  ii  log(n2 /m))  and  0(nm  log  /?  log  log  n)  time. 

Proof:  We  reduce  dt  by  a  factor  of  (1  —  c/8).  We  then  find  a  flow  /'  which  satisfies  the  reduced 
demand  d\  =  ( 1  —  c/8 )d{  and  which  cost  with  respect  to  (  is  no  more  than  cA  Yhiv  *"(  <’«’)«(  vtp)/(16k) 
above  the  minimum  cost.  Then  we  multiply  the  flow  on  every  edge  by  (1  —  c /S )~ 1 .  This  gives  a  flow 
that  satisfies  demands,  obeys  the  slightly  increased  capacity  constraints  (1  -  c/8)-1  A  •  tt(ru’).  and 
has  cost  (subject  to  C)  at  most  cC,/4-l-cA4>/(4A)  above  (?'.  where  $  is  the  current  potential  function 
value.  By  Theorem  5.2,  we  can  use  this  flow  and  still  get  the  same  asymptotic  improvement  in  the 
potential  function. 

Define  ft'  =  ec/;/(8m),  and  round  the  capacities  Xu(vic)  used  for  the  mill-cost  flow  problem, 
down  to  multiples  of  ft'.  It  is  easy  to  show  that  the  minimum-cost  flow  with  respect  to  (  that 
satisfies  the  decreased  demand  c/'  and  rounded  capacity,  is  no  more  than  C*. 

For  getting  the  approximate  minimum-cost  flow  we  can  work  with  a  further  rounded  length 
function.  We  take  C(vw)  to  be  the  integer  part  of  dtC{v*.v)/{XU).  Since  after  the  capacity  rounding 
we  consider  only  edges  with  Xu(vw)  >  ft',  we  have 


l(vw)  < 


16c  1 kmU  dt  16c  xkmd, 


ft’/X 


XU 


=  G( (  2 km2). 


Therefore  the  Goldberg-Tarjan  minimum-cost  flow  algorithm  runs  in  0[nm log( ri2/m ) log » )  time 
on  this  problem. 

Now  we  show  that  the  resulting  flow,  after  multiplication  by  (1  -  c/8)-1,  satisfies  (7).  The 
minimum-cost  flow  has  a  single  source  and  a  single  sink  and  non-negative  costs,  therefore  no  edge 
will  carry  more  than  d'{  units  of  flow.  Let  /*  be  a  minimum-cost  flow  with  respect  to  (.  By  an 
argument  similar  to  the  proof  of  Lemma  5.4  we  get  that  the  cost  of  this  flow  with  respect  to  (  is  at 
most  mdf- XU/di-eeaX/(l6kmU)  <  cA4>/(16A)  larger  than  the  cost  of  /'  with  respect  to  (.  where  /' 
is  the  minimum-cost  flow  with  respect  to  (  that  satisfies  the  reduced  demand  d\.  Now  Lemma  5.4 
implies  that  (7)  is  satisfied. 

For  all  but  very  dense  graphs  the  double  scaling  algorithm  of  Ahuja,  Goldberg,  Orlin  and 
Tarjan  [1]  gives  a  better  bound.  As  we  observed  no  edge  will  carry  more  than  c/'  units  of  flow  in 
the  optimal  flow  of  commodity  i.  Thus  we  can  also  limit  capacities  to  be  no  more  than  d'r  i.e. 
we  can  set  u'(vw)  =  min{  [A’'jpu  *J/d,c/'}.  With  this  modification,  the  largest  capacity  is  at  most 
d'  =  0(mc-1/t' ).  The  demand  and  the  capacities  are  multiples  of  ft'.  Dividing  through  by  the  scale 
factor  ft'  we  get  a  problem  with  integral  capacities  using  0(log?r)  bits.  | 

Combining  Theorem  5.5  and  Lemmas  4.1,  5.6,  5.7  and  5.8  we  get  the  following  theorem: 


Theorem  5.9  For  e  >  0,  an  e-optimal  solution  for  the  simple  concurrent  flow  problem  can  be 
found  either  in  expected  Otmnk(e~3  -f  log  k)  min{log(n2/m).  log  log??}  log  n)  time  or  Of  7??7/A'*(f-3  + 
logA;*)min{log(n2/m),loglog7!r}  \ogvl')  time;  and  deterministically  by  a  factor  of  k  and  k"  more 
time  with  the  power  of  epsilon  modified  to  be  (—2). 

If  the  capacities  in  the  concurrent  flow  problem  are  uniform  then  the  capacities  in  the  minimum- 
cost  flow  problem  are  all  equal  to  A.  In  this  case,  there  are  more  efficient  minimum-cost  flow 
algorithms  than  the  ones  mentioned  above. 

Lemma  5.10  For  the  simple  concurrent  flow  problem  with  uniform  capacities,  a  flow  for  a  commodity 
i  satisfying  (7)  can  be  found  in  0(m3/2logn)  time. 

Proof:  A  minimum-cost  flow  problem  with  demand  A[r/,/AJ  and  capacities  A  can  be  reduced  to 
an  assignment  problem  with  O(m)  edges  and  O(m)  nodes.  We  shall  use  the  assignment  algorithm 
of  Gabow  and  Tarjan  [2]  to  solve  this  rounded  problem.  The  remaining  flow  can  be  routed  by  a 
shortest  path  computation  in  the  residual  graph.  The  bounds  follow  by  arguments  similar  to  the 
used  in  the  proof  of  Lemma  5.7.  | 

The  resulting  time  bound  for  the  concurrent  flow  algorithm  with  uniform  capacities  improves 
the  previous  best  bound  [9]  if  k  <  ym/flog  n  log k). 

Theorem  5.11  For  c  >  0,  an  c-optimal  solution  for  the  simple  concurrent  flow  problem  with  uniform 
capacities  can  be  found  in  expected  0(km3/2  log2  n(e~3  +  log  4* ) )  time  and  in  0(A'2;u3/2log2  7f(f~2  + 
log  A1))  time  deterministically. 

When  both  the  capacities  and  demands  aremniform  and  k  is  relatively  large,  we  can  obtain 
better  performance  by  using  the  minimum-cost  flow  algorithms  of  [6]  and  [15]  that  repeatedly 
augments  the  flow  along  the  shortest  path  in  the  residual  graph.  The  resulting  time  bound  is  the 
same  up  to  log  factors  as  those  obtained  in  [9]. 

6  The  Minimum-Ratio  Cut  Problem 

As  an  application  of  our  concurrent  flow  algorithms  we  give  fast  implementations  of  the  minimum- 
ratio  cut  approximation  algorithms  of  Leighton  and  Rao  [10].  its  extension  to  hvpergraphs  by 
Makedon  and  Tragoudas  [11],  its  extension  to  node  weighted  graphs,  and  the  approximation  algo¬ 
rithm  of  Klein,  Agravval,  Ravi,  and  Rao  [8].  The  computational  bottleneck  of  these  algorithms  is 
solving  a  concurrent  flow  problem  and  its  linear  programming  dual.  First,  we  will  summarize  the 
minimum-ratio  cut  approximation  results.  Then  we  will  show  how  our  concurrent  flow  algorithm 
can  be  used  to  find  an  approximately  optimal  dual  solution  to  the  corresponding  concurrent  flow 
problems  in  addition  to  finding  a  near  optimal  flow.  Finally,  we  shall  give  even  faster  running 
times  for  the  special  case  of  the  Leighton-Rao  problem  where  the  input  graph  G  has  low  maximum 
degree. 

6.1  Cut  Approximation  Results 

Let  G  be  an  undirected  graph  with  capacities  on  its  edges.  For  a  subset  of  the  nodes  .4,  we  use  .4 
to  denote  the  complement  of  A,  the  associated  cut  is  the  set  of  edges  T(  .4 )  leaving  the  set  .4.  Let 
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udVU)  denote  the  sum  of  the  capacities  of  the  edges  in  the  cut.  Leighton  and  Rao  {10]  gave  an 
O(log  /^-approximation  algorithm  for  the  problem  of  minimizing  the  ratio  f/(r(/i))/(l-4||/i|)  over 
all  cuts.  By  applying  this  approximation  algorithm  they  obtained  polylog-times-optimal  approx¬ 
imation  algorithms  for  a  wide  variety  of  NP-complete  graph  problems,  including  minimum  flux, 
minimum  feedback  arc  set,  minimum  cut  linear  arrangement,  and  minimum  area  layout.  Makedon 
and  Tragoudas  [11]  extended  this  result  to  hypergraphs. 

Consider  the  concurrent  flow  problem  on  G  with  one  unit  of  demand  between  every  pair  of 
nodes.  Clearly  A’  must  satisfy  A*  ■  u( L( .4 ) )  >  d(A,A)  =  |A||/i|  for  every  cut  T(.4),  where  d(A.  .4) 
denotes  the  sum  of  all  demands  across  the  cut.  Therefore,  min  u(T( .l))/( |.4||  -1|)  over  all  cuts  l'(  .4  ) 
gives  an  upper  bound  on  1/A".  Leighton  and  Rao  show  that  this  minimum  is  within  an  0(log?/) 
factor  of  the  value  1  /A*. 

The  computational  bottleneck  of  the  Leighton  and  Rao  algorithm  is  computing  a  nearly  optimal 
A  and  the  corresponding  near  optimal  linear  programming  dual  solution  for  the  concurrent  flow 
problem  on  G  with  one  unit  of  demand  between  every  pair  of  nodes.  The  dual  solution  is  a 
non-negative  length  function  (  that  maximizes  the  ratio  J2v,w  dist((r.  U')/{YLmeE  "( t’<r)f(  nr))  (see 
Theorem  2.2).  Linear  programming  duality  implies  this  maximum  is  equal  to  A*.  Leighton  and 
Rao  use  a  linear  programming  algorithm  to  find  the  length  function. 

A  natural  extension  is  the  problem  where  we  are  given  nonnegative  node  weights  //( r )  for  v  6  C 
in  addition  to  the  capacities  on  the  edges.  For  a  subset  X  of  V  let  //(.V)  denote  the  sum  of  the 
weights  on  the  nodes  in  X.  Consider  the  extension  of  the  minimum-cut  problem  to  minimizing 
u(r(. 4 ))/(//’( A )//(/!))  over  all  cuts.  The  Leighton  and  Rao  algorithm  can  be  extended  to  give  an 
O(logn)  approximation  algorithm  for  this  problem.  The  corresponding  concurrent  flow  problem 
has  demand  between  every  pair  of  nodes,  where  the  demand  d(s,t)  between  nodes  .s  and  /  equals 
to  (If  the  weights  are  scaled  so  that  the  total  node-weight  is  ?/.  then  the  main  change  to 

the  Leighton-Rao  algorithm  is  to  select  the  node  s  for  starting  a  tree  with  //(s)  maximum.) 

Klein,  Agrawal.  Ravi,  and  Rao  [8]  extended  the  Leighton  and  Rao  results  to  the  case  of  simple 
concurrent  flow  problems  with  integral  capacities  and  arbitrary  integral  demands.  For  a  source- 
sink  pair  (s, /),  let  d{s,1)  denote  the  corresponding  demand.  The  minimum  ratio  cut  problem  is  to 
minimize  the  ratio  u(T(A))/d(A,  A)  over  all  cuts. 

The  minimum  value  is  an  upper  bound  on  1/A*  for  the  concurrent  flow  problem.  Klein.  Agrawal. 
Ravi,  and  Rao  [8]  proved  that  this  upper  bound  is  at  most  a  factor  of  Oflog  nU  log  kD)  above  1  /A* 
in  general  and  gave  an  0(log  uU  \ogkD)  approximation  algorithm  for  the  minimum  cut  problem, 
where  U  is  the  maximum  capacity  and  D  is  the  maximum  demand.  Tragoudas  [13]  has  observed 
that  their  algorithm  can  be  modified  to  give  the  0(log7t  log  kD)  factor  instead. 

Using  this  result  they  give  approximation  algorithms  for  chordalizat ion  of  a  graph  and  for 
register  sufficiency.  Similar  to  the  Leighton-Rao  algorithm,  the  computational  bottleneck  of  their 
algorithm  is  solving  the  dual  of  the  concurrent  flow  problem,  i.e.,  finding  a  length  function  (  such 
that  the  ratio  d(s,  1)dist((s,  t)/  YlvweE  u(vw)C(vxr)  is  close  to  maximum. 


6.2  Finding  Good  Dual  Solutions 

In  order  to  be  able  to  replace  linear  programming  in  the  minimum-ratio  cut  algorithms  bv  our  more 
efficient  algorithm,  we  need  to  compute  a  length  function  f,  such  that  for  some  constant  c  >  0.  this 
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function  satisfies 


(ii)  R(C)  = 


Es,tev  (l(s->t)dist^(s,t) 

Evt uSE  £(VW)U(VW) 


> 


A* 

1  +  €  ' 


In  other  words  we  wish  to  find  a  length  function,  £,  for  which  the  ratio  between  the  first  term 
without  the  A  and  last  term  in  (3)  is  at  least  A* /( 1  +  e).  In  order  to  do  so,  we  will  use  the 
concurrent  flow  algorithm  to  find  a  length  function  C.  We  show  with  respect  to  this  length  function 
the  ratio  of  the  first  term  without  the  A  and  last  term  in  (4)  is  close  to  A*.  We  then  show  how  to 
modify  this  length  function  so  that  if  satisfies  (11)  above. 


First  we  consider  the  concurrent  flow  problem  that  directly  corresponds  to  the  given  minimum- 
ratio  cut  problem,  and  combine  all  the  commodities  that  share  a  source  into  a  single  commodity 
as  suggested  Lemma  2.1.  This  decreases  the  number  of  commodities  to  k“  <  n.  We  shall  index  the 
resulting  commodities  by  their  sources.  Given  a  target  e,  if  our  concurrent  flow  algorithm  used  the 
exact  length  function  C,  it  would  compute  a  flow  satisfying  capacities  A  -  u(vw)  such  that: 


Q  = 


Es  c;w  y  _w_ 

E vweE^l,u’Mvw)  "  1  +  c  ‘ 


But  we  actually  compute  flows  with  respect  to  an  approximate  length  function  f,  described  in 
the  proof  of  Lemma  5.4.  Let  Q  denote  the  corresponding  ratio  with  (  replaced  by  (  and  C~  replaced 
by  C*.  First  we  show  that  Q  is  almost  as  close  to  A*  as  Q. 

Lemma  6.1  Let  /  be  the  flow  and  C  be  the  length  function  returned  by  our  algorithm.  Then  Q  > 


Proof:  Let  7  =  ceoA/(16 mkU).  Recall  that  this  is  the  factor  that  approximately  relates  the 
real  lengths  to  the  approximate  lengths.  By  the  way  the  approximate  lengths  were  computed. 
lC(viu)  <  £(vw)  for  every  edge  vw.  Also,  by  arguments  similar  to  those  used  to  derive  ( 10)  we  have 
that 

C*  -  7 C-  <  cA<F/(8/c)  <  cA“4»/(4Ar). 

Using  these  two  facts,  we  have  the  following  bound  on  Q: 
tEsQ(A) 


Q  = 


> 


> 


Evr ueE7C(vw)n(vw) 

7E.Q(A) 

Evw€E  ((vw)u( vw ) 

Es  Q(A)  -  tA»  EvweE  C(vw)ti{vw) 
EvwtE  C(vw)u{vw) 

Escn  a) 


/4 


LvweE?(vwMvw) 


eA*/4 


> 


cA* 


1  +( 


> 


1  -|- 


1 


Now  we  describe  how  to  modify  this  length  function  to  produce  one  that  satisfies  (11)  above. 
Observe  that  setting  t  -  t  does  not  necessary  work,  since  E*,tev^(siO distf-(s,<)  might  be  signifi¬ 
cantly  smaller  than  EjQ(A).  Instead  of  using  l  directly,  we  will  compute  a  new  length  function 
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L  The  idea  is  to  compute  a  minimum-cost  flow  with  respect  to  costs  (  and  capacities  A  •  u(vw)  for 
each  commodity  and  then  use  the  optimal  price  function  ps  to  change  (  by  adding  to  it  the  sum  of 
the  absolute  values  of  reduced  costs  for  edges  with  negative  reduced  costs. 

Let  /*  denote  the  minimum-cost  flow  for  commodity  s  with  respect  to  (,  and  ps  the  optimal 
price  function.  Let  us  denote  Cs(  vw)  =  -  min{0,  £(vw)  +  ps(v)  -  ps(w)}\  if-  is  the  absolute 

value  of  the  reduced  cost  if  it  is  negative,  and  zero  otherwise.  Recall,  that  the  complementary 
slackness  conditions  imply  that  if  Cs(vw)  >  0  then  f’(vw)  =  A u(viu).  We  define  the  new  length 
function  as  £(vw)  =  C(vir)  -f  £s(vw).'  We  need  the  following  lemma  to  estimate  the  numerator 
of  R{i). 

Lemma  6.2  The  flow  /*  is  minimum-cost  subject  to  cost  t  +  ts,  its  cost  is  Yt  d{s< 1  )dist(-+(  (s,  /). 

Proof:  We  prove  the  optimality  of  /*  by  showing  that  /*  and  the  price  function  pa  satisfy  the  com¬ 
plementary  slackness  conditions.  By  the  definition  of  (s  we  have  that  C(viv)  -f  Cs(rw )  +  ps(  >’)  —  ps(  «•) 
is  nonnegative  and  it  is  positive  if  and  only  if  ((vw)  +  ps(v)  —  ps(w)  is  positive.  By  complementary 
slackness  applied  to  cost  f,  flow  /*  and  prices  ps,  if  this  value  is  positive,  then  /*  is  zero. 

Now  consider  the  cost  of  /*  subject  to  the  cost  function  £+(s.  There  are  no  edges  with  negative 
reduced  cost,  therefore  the  cost  of  the  flow  is  at  least  Yt  d(s,  t){f>a(t)  -ps(-s)).  All  edges  that  carry 
flow  have  zero  reduced  cost.  This  implies  that  the  cost  of  the  flow  is  equal  to  Yt  d(s.  t  ){ps{  f  )~ps(*)) 
and  ps(t)  -  ps(s)  =  distf-+<,  (s,f).  | 

Theorem  6.3  R(()  >  (1  +2e)_1A*. 

Proof:  We  shall  estimate  the  numerator  of  R(C)  using  the  above  lemma.  For  a  source  s  we  have 
that 

^d(s,f)dist f(s,t)  >  ^d(s,Odist^-+(s(s,f)  =  ]T(f(i 'w)+Cs(vw))j;(vtv)  =  Ca(\)+J^(s(vw)f;(vw). 

i  t  VW  vw 

By  complementary  slackness,  and  the  definition  of  Cs  we  find  that  if  Cs(vw)  ^  0  then  /’( vir )  = 

A u(vw).  Summing  over  all  sources  we  get  that 

d(s,t)distj(s,t)  >  53C;(A)  +  \^2u(vw)'^2cs(vw). 

s,t£V  s  vw  s 

Dividing  the  two  sides  of  this  equation  by  Yvw  C(vw)u(vxr)  we  get  that 

*Y,vw  u{uw)Y,(*(i'U') 

~  YLvw  u(vxv)i(vw)  +  Yvw  U(VW)Ys  Cs(vw) 

Applying  the  simple  mathematical  fact  that  for  positive  a,  b,  .r  and  A,  if  n/b  <  A  then  («  +  A x)/(b  + 
x)  >  a/b,  we  see  that  the  left  side  of  the  above  equation  is  at  least  Q  which  by  Lemma  (i.l  is  at 
least  A*/(l  +  2e).  | 

Corollary  6.4  An  e-optimal  flow  and  length  function  pair  (/,  ()  produced  by  our  concurrent  flow 
algorithm  can  be  translated  into  a  length  function  C  needed  by  the  minimum-ratio  cut  algorithms 
in  0[kmnm  log(n2/m)  log(nf/))  time.  The  dual  objective  value  associated  with  (  will  be  within  an 
(1  —  0(c))  factor  to  the  optimum. 
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We  can  use  the  approximate  minimum-cost  flow  computation  in  Lemma  5.7  instead  of  Lemma  5.6. 
With  an  argument  similar  to  the  above,  but  somewhat  more  involved,  we  replace  the  log(7?2/???)  in 
the  theorem  by  a  log  logoff  ).  We  obtain  the  following  corollary. 

Corollary  6.5  An  0(log  ?!  ^approximation  to  the  node  weighted  cut  problem  with  general  capacities 
can  be  found  in  0(  n2m  log  n  17  log2  n  min{log(n2/m),  log  log  nU})  expected  time.  An  O(log  n  log  kD ) 
-approximation  to  the  minimum-ratio  cut  problem  with  general  demands  and  capacities  can  be  found 
in  0(k*nm  log  nU  log  k  log  n  min{log(?i2/?7?),  log  log  nU)  )  expected  time. 

An  analogous  theorem  can  be  obtained  for  finding  approximately  sparsest  cuts  in  hypergraphs  using 
the  concurrent  flow  algorithm  in  conjunction  with  the  approximation  algorithm  of  Makedon  and 
Tragoudas  [11], 

6.3  Graphs  with  Low  Maximum  Degree 

Next  we  improve  the  running  time  given  in  Corollary  6.5  for  low-degree  graphs  C.  The  new  running 
time  will  depend  on  A,  the  maximum  degree  of  any  node  in  the  graph. 

We  consider  the  minimum-ratio  cut  problem  for  graphs  with  unit  demands,  where  the  graph 
that  has  an  edge  between  the  source  and  sink  of  each  commodity  is  a  const  ant  degree  expander  on 
V.  (We  call  this  graph  the  demand  graph.)  While  the  case  of  the  expander  demand  graph  with 
unit  demands  seems  like  an  obscure  special  case,  it  is  in  fact  an  important  one.  The  Leighton  and 
Rao  [10]  algorithm  uses  the  solution  of  a  concurrent  flow  problem  in  which  the  demand  graph  is 
the  complete  graph.  However,  one  can  modify  the  Leighton  and  Rao  algorithm  to  use  the  solut  ion 
to  this  new  concurrent  flow  problem  and  its  dual  problem  to  derive  an  0(log??)  approximation  to 
the  minimum-ratio  ?t(T(  A))/(|  A||A|)  over  all  cuts.  To  get  an  idea  how  the  two  problems  are  related 
consider  a  cut  T(A)  and  assume  that  |A|  <  |A|.  Because  the  demand  graph  is  a  constant  degree 
expander,  c|/l|  <  d(A,A)  <  c|A|  for  some  constants  c  and  c.  Therefore,  u{T(A))/d[A.  A)  is  0(7?) 
times  more  than  ?t(T(/l))/(|  A||A|). 

The  first  step  in  solving  this  problem  is  to  round  all  the  capacities  up  to  integer  multiples  of  a 
parameter  /t  in  such  a  way  that  the  ratio  u(r(/l))/(|A||/i|)  is  not  changed  by  more  than  a  factor  of 
two.  Notice  that  [ T ( A ) j  <  A|A|.  We  shall  use  r  to  denote  the  maximum  of  |F(.4)j/f/(  A.  A)  over  all 
cuts  T(/l).  Notice  that  r  <  A/c,  where  c  is  the  expansion  parameter  of  the  demand  graph. 

Theorem  6.6  Let  A*  be  the  optimum  value  of  the  concurrent  flow  problem,  and  let  /?  <  (rA*)_1. 
If  we  round  each  capacity  tt(e)  up  to  u(e),  the  next  integer  multiple  of  //,  then  the  minimum  ratio 
«(T( A))/(|A||A| )  of  a  cut  T(/4)  with  capacity  it  is  at  most  twice  of  the  minimum  ratio  with  u. 

Proof:  For  all  cuts  T(/l),  it  must  be  that  A*?i(r(/1))  >  d{A,A).  The  rounding  error  u ( T ( A ) )  - 
?t(r(A))is  at  most  /z|r( A)|  <  |T( A)](2rA*)_1  <  d(A,A)|/A*  <  7t( T(  A)).  This  implies  that  for  every 
cut  *(r(A)|/(|A||A|)  <  2w(r(A))/(|A||A|),  i.e.  the  new  ratio  is  at  most  twice  the  old  ratio.  | 

Rounding  to  integer  multiples  of  p  preserves  the  minimum-ratio  cut  up  to  a  factor  of  two.  If 
we  want  to  preserve  A*  up  to  a  constant  factor  we  have  to  do  a  somewhat  finer  rounding. 

Theorem  6.7  Let  A*  be  the  optimum  value  of  the  concurrent  flow  problem 

and  let  /«  <  c(20rA*  log  mU  log  7i)— 1 .  If  we  round  each  capacity  u(e)  up  to  77(e),  the  next  integer 
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multiple  of  /z,  then  the  minimum  congestion  A*  subject  to  capacities  u(e)  is  at  most  a  factor  of  1  +  £ 
less  than  the  minimum  congestion  A*  with  u. 

Proof:  The  idea  is  to  use  the  O(lognlog  kD)  approximation  result  of  Klein.  Agrawal.  Ravi,  and 
Rao  [8]  as  improved  by  Tragoudas  [13].  Consider  the  following  auxiliary  concurrent  flow  problem. 
The  graph  is  G  with  capacities  ».  For  every  edge  vw  £  E  there  is  a  demand  of  value  (l(v,w)  = 
u(vw)  -  u(vw)  from  v  to  w.  Observe  that  the  demands  in  the  auxiliary  problem  are  integral  and  at 
most  /z,  and  logp  is  at  most  log(em£f/(20r  log uU  log n))  <  2 log (mU).  Using  the  same  estimates 
as  in  the  previous  proof  we  can  conclude  that  the  minimum  of  zz( F(  A))/d{A,  A)  over  all  cuts  Tf/l) 
is  at  most  e/(20  log  mU  log  n).  By  the  above  approximation  result  the  minimum  congestion  A*  for 
this  problem  is  at  most  e.  That  is,  the  added  capacities  can  be  routed  in  an  e-fraction  of  the  original 
capacities  u. 

Now  consider  an  optimal  flow  /  of  congestion  A’  in  the  rounded  problem.  To  get  a  solution 
in  the  original  problem  we  route  the  part  of  flow  /  that  uses  the  added  capacity  in  the  wav  this 
demand  is  routed  in  the  optimal  solution  to  the  auxiliary  problem.  This  does  not  increase  the 
congestion  by  more  than  a  factor  of  1  +  c.  | 

Next  consider  the  question  of  how  long  it  takes  to  solve  a  rounded  concurrent  flow  problem. 
For  simplicity  we  shall  restrict  our  attention  to  the  case  when  c  is  a  constant.  The  number  of 
commodities  is  O(n).  The  capacities  in  the  minimum-cost  flow  problem  are  integer  multiples  of 
A/z.  We  shall  use  the  minimum-cost  flow  algorithm  due  to  Ford-Fulkerson  [6]  and  Yakovleva  [15]. 
that  repeatedly  augments  the  flow  along  the  shortest  path  in  the  residual  graph,  to  solve  these 
problems.  Given  a  concurrent  flow  with  congestion  A,  the  number  of  shortest  path  computations 
in  a  minimum-cost  flow  subroutine  is  at  most  /z-1  A-1  +  1.  the  upper  integer  part  of  the  demand, 
which  is  1,  divided  by  the  unit  of  the  capacity,  which  is  A/z. 

We  use  these  ideas  to  solve  the  minimum-ratio  cut  and  the  concurrent  flow  problem.  The 
0{( A-1/t_1  +  l)(m  +  nlogn))  time  required  for  solving  the  minimum-cost  flow  problem  might  not 
dominate  the  O(mlogn)  needed  to  compute  the  approximate  length  function.  To  simplify  the 
bounds  we  shall  count  each  minimum-cost  flow  computation  as  0((A_1/z_1  +  l)mlog«))  time. 
These  bounds  can  be  further  improved  by  using  the  data  structures  described  in  [9]. 

Notice  that  here  we  do  not  have  time  to  find  an  initial  flow  using  k  maximum-flow  computations 
suggested  in  Lemma  4.1.  The  capacities  of  this  problem  are  not  rounded,  therefore  we  have  to  use 
a  general  maximum-flow  algorithm,  and  all  such  algorithms  take  Q{inv)  time.  However,  an  initial 
flow  that  is  optimal  up  to  a  factor  of  O(mlc)  can  be  computed  by  routing  each  demand  on  the  path 
with  maximum  bottleneck  capacity  from  its  source  to  its  sink. 

An  iteration  of  the  algorithm  will  use  Theorem  6.6  or  6.7  with  /z  defined  by  c(AA0)-1  (respec¬ 
tively  cc(20AAologmf/log 7z)_1 ).  We  terminate  the  iteration  if  A  decreases  below  Ao/2.  At  that 
point  we  divide  A0  by  two,  and  start  the  next  iteration.  We  use  the  flow  obtained  in  the  previous 
iteration  as  our  initial  flow. 

Theorem  6.8  An  O(logn)  approximation  to  the  minimum  ratio  u(r(  A))/( |A||A|)  over  all  cuts  T ( -1 ) 
in  a  graph  with  capacities  u  and  maximum  degree  A  can  be  computed  in  0{jimA  log3  v )  expected 
time. 

Theorem  6.9  For  any  constant  e,  an  c  approximation  to  a  unit  demand  concurrent  flow  problem  in 
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a  graph  with  maximum  degree  A  with  a  constant  degree  expander  demand-graph  can  be  computed  in 
0(nmAlog4  nlognU)  expected  time. 

In  regular  gu.riis  nA  =  m,  therefore  the  running  times  of  the  above  two  algorithms  are  roughly 
(up  to  a  polylogarithmic  factor)  0(m2). 
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